Valency for Adaptive Homeostatic Agents: Relating Evolution and Learning
نویسندگان
چکیده
This paper introduces a novel study on the sense of valency as a vital process for achieving adaptation in agents through evolution and developmental learning. Unlike previous studies, we hypothesise that behaviour-related information must be underspecified in the genes and that additional mechanisms such as valency modulate final behavioural responses. These processes endow the agent with the ability to adapt to dynamic environments. We have tested this hypothesis with an ad hoc designed model, also introduced in this paper. Experiments have been performed in static and dynamic environments to illustrate these effects. The results demonstrate the necessity of valency and of both learning and evolution as complementary processes for adaptation to the environment.
منابع مشابه
Evolving A Sense Of Valency
One way in which organisms learn is by feelings of pleasure and pain, which can be said to be equivalent to the reward function commonly used in computational applications of reinforcement learning. It is likely that pleasure and pain have become associated with good and bad actions through evolution, and similarly one might wish to investigate if it is possible to evolve the reward function us...
متن کاملValency as a Mechanism for Agent Adaptation
This paper introduces valency as an adaptive mechanism. It has been previously hypothesised that valency assesses the agent’s behavioural patterns and guides adaptation. However, we argue that it acts furthermore as a mechanism guiding the interaction between learning and evolution. Unlike previous studies, we hypothesise that behaviour related information must be underspecified in the genes an...
متن کاملA Differential Evolution and Spatial Distribution based Local Search for Training Fuzzy Wavelet Neural Network
Abstract Many parameter-tuning algorithms have been proposed for training Fuzzy Wavelet Neural Networks (FWNNs). Absence of appropriate structure, convergence to local optima and low speed in learning algorithms are deficiencies of FWNNs in previous studies. In this paper, a Memetic Algorithm (MA) is introduced to train FWNN for addressing aforementioned learning lacks. Differential Evolution...
متن کاملLearning and Evolution of Autonomous Adaptive Agents
We study a model of evolving populations of self-learning agents and analyze the interaction between learning and evolution. We consider agent-brokers that predict stock price changes and use these predictions for selecting actions. Each agent is equipped with a neural network adaptive critic design for behavioral adaptation. We discuss three cases in which either learning, or evolution, or bot...
متن کاملAn Online Q-learning Based Multi-Agent LFC for a Multi-Area Multi-Source Power System Including Distributed Energy Resources
This paper presents an online two-stage Q-learning based multi-agent (MA) controller for load frequency control (LFC) in an interconnected multi-area multi-source power system integrated with distributed energy resources (DERs). The proposed control strategy consists of two stages. The first stage is employed a PID controller which its parameters are designed using sine cosine optimization (SCO...
متن کامل